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(54) IMAGE PICKUP DEVICE 

(57)Abstract: 

PURPOSE: To provide an image pickup device in which 
an original picture can be exactly restored without being 
affected by an optical system even at the time of 
handling a continuous system and a discrete system. 
CONSTITUTION: In a sensitivity function measuring 
means, a CMD 10 which picks up a light from a light 
source 1 is arranged through a photographing lens 4 and 
a liquid crystal lens 5, and a pre-amplifier 12, A/D 
converter 13, subtracter 14, sensitivity function memory 
16, compressor 17, and sensitivity function memories 
19r, 19g, and 19b for R, G, and B are connected through 
a switching circuit 18 to the CMD 10 in this order. And 
also, in a picture restoring means which restores the 
original picture by using the sensitivity function searched 
by the sensitivity function measuring means, a calculator 
28 which calculates the restored picture is connected to 
a frame memory 23 which stores a picture signal picked 
up by the CMD 10, each of calculators 26 and 27 which 
calculate the sensitivity function stored in the sensitivity 
function memories 19r, 19g, and 19b, and a display device 29 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1 This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] Image pick-up equipment which has a sensitivity function storage means by which the 
sensibility function data showing the photosensitivity in the object space in each point of 
photography optical system, the image sensor for picturizing the body image by which incidence 
is carried out through said photography optical system, and said image sensor was memorized 
beforehand, and an image restoration means to restore the image data picturized by said image 
sensor using the sensibility function data memorized by said sensitivity function storage means. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to image pick-up equipment equipped with an image 
restoration means to restore correctly the image data which started image pick-up equipments, 
such as an electronic "still" camera which picturizes a subject-copy image and is restored, 
especially deteriorated. 
[0002] 

[Description of the Prior Art] As everyone knows, it sets to imaging systems, such as an 

electronic "still" camera using optical system, and is subject-copy image f (r) (r expresses a 

location) like drawing 3 . Optical system L is minded and it is observation image g (r). Image 

formation is carried out on the image sensor which do not illustrate by carrying out. 

[0003] here — subject-copy image f (r) the Fourier spectrum — F (omega) and observation 

image g (r) the Fourier spectrum — G (omega) — then — G(omega) =H(omega) xF (omega) — 

(1) 

( — here, it can express omegarspatial-frequency). 

[0004] At this (1) type, it is H (omega). It is called an optical transfer function (OTF:Optical 
Transfer Function) and is used as a thing showing the image formation property of a imaging 
system. 

[0005] Moreover, what carried out the inverse Fourier transform of the H (omega) is called a 
point spread function (PSF:Point Spread Function). 

[0006] Now, observation image g (r) Subject-copy image f (r) In order to compare and to become 
completely the same, it needs to be set to H(omega) = 1 to all omega. 
[0007] However, generally actual optical system is set to H(omega) < 1, and degradation 
produces it in an image. 

[0008] Then, the technique by the inverse filter (Inverse Filter) is known as an approach of 
restoring a subject-copy image from an observation image. 

[0009] This Inverse About Filter, it is Prentice-Hall, for example as reference. International 
"Fundamentals of Digital Image Processing" of Editions issue, ANIL It is explained to the KJAIN 
work P275-P277 in detail. 

[0010] Then, according to this reference, it is a restoration filter. H-=(omega) 1/H (omega) — (2) 
It ****. 

[001 1] However, since this filter is expressed with the inverse number of H (omega), H- (omega) 
will emit at the time of H(omega) = 0. Then, H-=(omega) 1/H (omega) (at however, the time of H 
(omega)!=0) — (3) 

H- omega= 0 (at however, the time of H(omega) = 0) — (3') 
It ****** 

[0012] 

[Problem(s) to be Solved by the Invention] the restoration filter shown by (2), (3), and (3') the 
formula which were mentioned above — which location of an image — even if it is, the so-called 
PSF(s), such as intensity distribution of the image of optical system to the point, are equal 
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(space-invariant) — ** — the conditions to say were required. 

[0013] However, since various aberration and foci were carried out under the effect of a gap etc. 
in actual optical system and PSF changed with the locations of an image (space-variant), with 
the restoration filter shown by (2) and (3) formulas, a subject-copy image was not able to be 
restored correctly. 

[0014] Moreover, although using the restoration filter shown by (2) and (3) formulas is also 
considered after measuring different PSF according to an image location correctly in such a 
case, it becomes a problem from the sampling first at measurement of PSF. 
[0015] That is, in spite of defining the image as continuation in an observation image side, in an 
image sensor etc., it will dissociate for every pixel of the, PSF will sample an image discretely, 
and the exact measurement of PSF of it becomes impossible. 

[0016] Therefore, with the conventional restoration filter, exact restoration of a subject-copy 
image will essentially be impossible. 

[0017] This invention is made in view of the above points, and when a continuous system and a 
discrete time system are treated, it aims at offering the image pick-up equipment which cannot 
be influenced of optical system but can restore a subject-copy image correctly. 
[0018] 

[Means for Solving the Problem] The image pick-up equipment of this invention has a sensitivity 
function storage means by which the sensibility function data showing the photosensitivity in the 
object space in each point of photography optical system, the image sensor for picturizing the 
body image by which incidence is carried out through said photography optical system, and said 
image sensor was memorized beforehand, and an image restoration means to restore the image 
data picturized by said image sensor using the sensibility function data memorized by said 
sensitivity function storage means. 
[0019] 

[Function] A sensitivity function storage means memorizes the sensibility function data 
measured by picturizing the body image by which incidence is beforehand carried out through 
photography optical system, for example with an image sensor. And an image restoration means 
asks for restoration image data by using the image data picturized with the image sensor through 
photography optical system, and the sensibility function data for which it asked with said 
sensitivity function storage means. 
[0020] 

[Example] First, in advance of explanation of the example of this invention, the restoration 
approach of the subject-copy image using the sensitivity function used as the principle of this 
invention is explained. 

[0021] Subject-copy image f which is a sequential image as shown in drawing 3 (a) now (r) 
Observation image g which is a discrete image in the image sensor (not shown) which carried out 
image formation according to optical system L, and which was set to the image formation side (r) 
An image restoration means to restore with the sensitivity function storage means and its 
sensitivity function in the case of picturizing is considered. 

[0022] When picturizing with an image sensor, as it is shown in drawing 3 (b) here, it is this 
observation image g (rX It is considered a discrete image and a model can be made like a degree 
type. 
[0023] 

gi =integralf (r) xhi(r) dr — (4) 

At this (4) type, hi (r) is observation image g (r). If it is a function showing the sensitivity profile 
which contributes to the i-th pixel and all pixels are expressed collectively g (r) =H {f (r)} — (5) 
By this becoming (5) formula, H{ ] is considered as a conversion operator from a sequential image 
to a discrete image, and calls a sensitivity function. 

[0024] Now, subject-copy image [ as a continuous function ] f (r) Since it defines as the 
continuous system, it will have the point of an infinity individual within the limits of an 
observation image, and the base vector in object space will be considered to be an infinity 
individual. 

[0025] The train of a sensitivity function H serves as an infinity individual, and it becomes 
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impossible therefore, to define the sensitivity function itself 

[0026] then, transposed matrix HT of H as the conversion operator from a discrete time system 
to a continuous system — giving a definition — HHT ******** — it thinks. That is, they are m, 
then HHT about the number of pixels of an image sensor now. It becomes possible to become a 
mxm matrix and to consider an inverse matrix. And the restoration image fe (r) is called for by 
the degree type. 
[0027] 

fe(r) =Hs T+CHHT) g (r) — (6) 

this (6) type — + — a SHUDO in berth (pseudo inverse) — the so-called false inverse matrix is 
expressed. 

[0028] Moreover, HHT If each element is set to aij aij=integralhi(r) xhj(r) dr — (7) 
It is given by carrying out. 

[0029] This (HHT) + Various approaches can be considered for calculation, for example, it is 
(HHT)+ by SVD analysis. It is computable. 

[0030] It is the abbreviation for the Cingular value deconstructivism position (SingularValue 
Decomposition) in this SVD, and it is used for the data compression of an image, the property 
analysis of a linear system, etc., and is explained to P176-P180 of the above-mentioned 
reference. 

[0031] Moreover, when there is a noise, it sets at (6) ceremony, and it is HHT. What is necessary 
is just to use HHT+cI (for c to be a constant and for I to be a unit matrix) instead. 
[0032] Furthermore, since the location r of a subject-copy image is arbitrary in (6) types, it 
means that the picture signal of any locations of a subject-copy image can be searched for 
irrespective of the several m pixel of an image sensor. 

[0033] That is, since the field of arbitration can be picturized corresponding to a several m pixel, 
an electronic zoom becomes possible, without performing a interpolation operation. 
[0034] It is Hs T of (6) types here. The conversion for displaying a restoration image can be 
considered, Suffix s expresses the number of display pixels, and it is Hs T. It is expressed with a 
sxm matrix. 

[0035] Thus, in this invention, the observation image defined as the discrete image is restored by 
measuring a sensitivity function H with a sensitivity function measurement means by the image 
restoration means using (6) types considering a subject-copy image and the subject-copy image 
which is the same continuation as a sequential image instead of measuring PSF in count. 
[0036] Here, the above-mentioned sensitivity function measurement means is explained using 
drawing 1 which shows the configuration. In addition, although a two-dimensional image is treated 
in fact, in order to simplify explanation, the notation of an image decides to express with one 
dimension. 

[0037] That is, in drawing 1 , the source 1 of the illumination light is arranged so that the light 
from the point light source may be picturized by CMD10 through a field diaphragm 3 and a taking 
lens 4. 

[0038] This source 1 of the illumination light is being fixed to X-Y stage 2 which moves in the 
inside of a field perpendicular to the optical axis of a taking lens 4. 

[0039] And in order to change the optical path of the light which passed the taking lens 4, a 
column is carried out to a taking lens 4, and the liquid crystal lens 5 is arranged. 
[0040] Here, a field diaphragm 3 and the liquid crystal lens 5 are connected to the field angle 
setting circuit 21 which makes the diaphragm driver 6 and the liquid crystal lens driver 7 which 
control each drive. 

[0041] Image formation of the light which passed the liquid crystal lens 5 is carried out to the 
charge modulation element (it is hereafter described as CMD) 10 as an image sensor through the 
turnable filter 8 connected to the color filter driver 9. 

[0042] A preamp (pre amplifier) 12 and the analog-to-digital (A/D) converter 13 are connected 
to this CMD 10. 

[0043] Furthermore, the memory (it is described as FPN memory below) 15 said fixed pattern 
noise of CMD 10 is beforehand remembered to be, and said A/D converter 13 are connected to 
two input edges of a subtractor 14, respectively. 
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[0044] Moreover, the memory 1 6 (since especially a sensitivity function will be memorized, it is 
described as sensitivity function memory below) for memorizing the picturized data is connected 
to the outgoing end of a subtracter 14. 

[0045] Here, although the number of trains will originally become infinity, in fact, since such 
measurement is impossible, a sensitivity function H considers as a finite individual (n pieces), and 
as shown in this memory at drawing 4 , it memorizes a sensitivity function in the form of a mxn 
matrix. 

[0046] That is, the sensitivity profile hi of the pixel i to which each line corresponds (r) is 
memorized. 

[0047] And the change circuit 18 which performs a change in each memory of sensitivity 
function memory 19for (Red R) r [ for the RGB three primary colors ] and sensitivity function 
memory 19g for (Green G) and sensitivity function memory 19b for (Blues B) is connected to the 
outgoing end of the sensitivity function memory 16 through the data compression machine 17. 
[0048] Moreover, the address controller 20 is connected to sensitivity function memory 19gfor 
sensitivity function memory 19for R r, and G, and sensitivity function memory 19for B b, 
respectively. 

[0049] Furthermore, the CMD driver 11, the FPN memory 15, the change circuit 18, and the 
address controller 20 for controlling the color filter driver 9 for controlling said X-Y stage 2, the 
field angle setting circuit circuit 21, and the rotation color filter 8 and the drive of CMD 10 are 
connected to the controller 22, respectively. 

[0050] Next, the measurement of a sensitivity function H based on the above-mentioned 
configuration is explained. 

[0051] first, measurement — each color image of RGB — it carries out for every field angle 
separately. 

[0052] In this case, although a sensitivity function H is a conversion operator from a continuous 
system to a discrete time system as mentioned above, and that number of trains will originally 
become an infinity individual, since such measurement is impossible, in fact, it measures as n 
pieces and suppose that it computes by the interpolation operation so that it may mention later 
about a required location. 

[0053] As shown in a sensitivity function H at drawing 4 , the sensitivity profile in each 
observation image location shall be located in a line with a line writing direction, and the 
sensitivity profile in each observation image location shall be located in a line in the direction of 
a train here. 

[0054] And it asks for this sensitivity function by picturizing in each observation image location, 
shifting the source 1 of the illumination light. 

[0055] Next, while ac(justing a field diaphragm 3 by control of the diaphragm driver 6 so that a 
field angle may be set to thetamax (equivalent to drawing 5 (a)) by the field angle setting circuit 
21 after setting the rotation color filter 8 to R by the color filter driver 9 for a concrete 
operation of a sensitivity function measurement means, the liquid crystal lens 5 is adjusted by 
control of the liquid crystal lens driver 7. 

[0056] and the location on a subject-copy image — drawing 5 (a) — like — a full field — n 
location (x1 ? x2, — xn) — it is — etc. — a part is carried out, the source 1 of the illumination 
light is moved to the location x1 on a subject-copy image by the drive of X-Y stage 2, and it 
picturizes by CMD 10. 

[0057] Here, a field angle setup with a field diaphragm 3 and the liquid crystal lens 5 is explained 
using drawing 5 . As mentioned above in this invention, even if it does not change especially a 
field angle from (6) types, an electronic zoom is possible, but by inputting only more light of the 
photographic subject image which you want to restore, since the precision of restoration is 
raised, such a field angle setting circuit 21 has been formed. 

[0058] Concretely, drawing 5 (a) is an example in the case of being equivalent to a wide angle 
lens, a field diaphragm 3 is opened widely, and the refractive index of the liquid crystal lens 5 is 
controlled so that the refractive power becomes large. 

[0059] And it is reverse, d rawin g 5 (b) is an example in the case of being equivalent to a 
telephoto lens, its field diaphragm 3 is narrow, and the refractive index of the liquid crystal lens 5 
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is controlled so that the refractive power becomes small. 

[0060] That is, in looking far. the light of a photographic subject image will carry out incidence to 
the refractive index of the liquid crystal lens 5 being the same as drawin g 5 (a) at some image 
sensors, but by lowering a refractive index like drawin g 5 (b), the light of a photographic subject 
image can carry out incidence to the whole image sensor, and futility can be lost. 
[0061] Moreover, it becomes [ changing a field angle easily and ] possible by using a field 
diaphragm 3 and the liquid crystal lens 5. 

[0062] in addition, this field angle — a controller 22 — minding — thetamin - thetamax which 
can be set up in the field angle setting circuit 21 up to — it is made to be changed to 
predetermined every field angle (for it to be described as thetaint below) 

[0063] next, the picture signal picturized by the pixel i of CMD10 — sensitivity profile hi (x1) it is 
— the picture signal is amplified by pre amplifier 12, and after being changed into a digital signal 
with A/D converter 13, it is written in the 1st train of each line of the sensitivity function 
memory 16 as the sensitivity-profile signal, i.e., sensibility function data, with which the fixed 
pattern noise of CMD memorized by the FPN memory 15 with the subtracter 14 was subtracted. 
[0064] And next, the source 1 of the illumination light is moved to the location of x2, same 
processing is performed, and the obtained sensibility function data is written in the location 
equivalent to the 2nd train of each line of the sensitivity function memory 16. Hereafter, same 
processing is performed until the source of the illumination light becomes the location of xn, and 
the sensibility function data in each location is written in the corresponding sensitivity function 
memory 16. 

[0065] And the amount of data is compressed with a compressor 17, and each value of the 
sensitivity function memory 16 is sensibility function data Hthetamax. It carries out and 
sensitivity function memory 1 9r for R memorizes. 

[0066] next, a field angle — thetaint only — sensibility function data Hthetamax-int obtained by 
making it small and processing similarly It memorizes to sensitivity function memory 19r for R. 
[0067] and — such — thetaint only — each different visual fields of all — crossing — sensibility 
function data — memorizing — final — a field angle — thetamin The same processing is 
repeated until it becomes. 

[0068] In addition, in detection, the visual field will be picturized in n location which divides the 
range of the predetermined locations x1-xn of a subject-copy image equally. 
[0069] Above, storage of the sensibility function data to R image is finished, the sensibility 
function data of G and B image is called for similarly, sensitivity function memory 19g for G and 
sensitivity function memory 19b for B memorize, respectively, and storage of sensibility function 
data is completed. 

[0070] Next, the image pick-up equipment equipped with the image restoration means which 
restores the image picturized by the image sensor using the sensibility function data called for 
by this measurement is explained. 

[0071] Drawing 2 is a block diagram about the 1st example of the image pick-up equipment 
equipped with an image restoration means to apply the method of restoring an image to the so- 
called zooming, using the sensibility function data for which it asked with the above-mentioned 
sensitivity function measurement means. 

[0072] In addition, the same sign is attached about the same configuration as drawing 1 , and 
those detailed explanation is omitted. 

[0073] In drawing 2 , the frame memory 23 which memorizes image data is connected to the 
subtractor 14 in the sensitivity function measurement means of above-mentioned drawin g 1 . 
[0074] And sensitivity function memory 19for R r [ which had been connected to the compressor 
17 through the change circuit 18 in drawin g 1 ] and sensitivity function memory 19gfor G and 
sensitivity function memory 19b for B are connected only to the address controller 20 in dr awing 
2 . 

[0075] As it mentioned above in each of this memory 19r, 19g, and 19b, the sensibility function 
data of R, G, and B image is memorized, respectively, and the change circuit 24 for choosing the 
output from them is connected to a controller 22. 

[0076] And it changes as an image restoration means, a circuit 24 minds the data expandor 25, 
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and it is + (HHT). The calculation machine 26 and Hs T It connects with the calculation machine 
27. 

[0077] Furthermore, said each calculation machines 26 and 27 and frame memory 23 are 
connected to fe(r) calculation machine 28 that restoration image data should be computed from 
the each calculation output and said image data. 

[0078] And the display 29 which displays the restoration image of the photography photographic 
subject 30 which exists in the front face of a taking lens 5 through a field diaphragm 3 is 
connected to fe(r) calculation machine 28. 

[0079] Next, the operation of image restoration equipment based on the above-mentioned 
configuration is explained. 

[0080] A field diaphragm 3 and the liquid crystal lens 5 are adjusted by the field angle setting 
circuit 21 through a controller 22 so that it may become the field angle theta expected that the 
image pick-up to the image pick-up photographic subject 30 starts. 

[0081] And the exposure time of CMD10 is set up by the photometry system which is not 
illustrated, and the rotation color filter 8 is set to R by the color filter driver 9 through a 
controller 22. 

[0082] Furthermore, the picture signal with which the image pick-up photographic subject 30 is 
picturized by CMD10 through optical system 3, 4, and 5, and is acquired is image data g (r) to the 
back frame memory 23 from which it was amplified by pre amplifier 1 2, and it was changed into 
the digital signal with A/D converter 13, and FPN was subtracted with the subtractor 14. It 
memorizes by carrying out. 

[0083] On the other hand, sensibility function data H corresponding to the field angle theta is 
read from sensitivity function memory 19for R r by the address controller 20, and it is inputted 
into the expandor 25 of data through the change circuit 24. 

[0084] A sensitivity function H is decoded in the data expandor 25, and it is (HHT)+. The 
calculation machine 26 and Hs T It is inputted into the calculation machine 27. 
[0085] (HHT) + With the calculation machine 26, it is HHT by (7) types first. Each component is 
calculated, and it continues and is + (HHT). It is calculated. 

[0086] Moreover, Hs T It is Hs T by asking for s elements for a display by the interpolation 
operation from the sensitivity profile hi (r) which consists of n elements with the calculation 
vessel 27, and transposing this. It asks and inputs into fe(r) calculation machine 28. 
[0087] g inputted from a frame memory 23 with fe(r) calculation vessel 28 (r) (HHT) + + inputted 
from the calculation machine 26 (HHT) And Hs T Hs T inputted from the calculation machine 27 
Based on (7) types, the restoration image data fe of R (r) is computed, and it outputs to a 
display 29. 

[0088] After computing restoration image data similarly about G and B image furthermore, it is 
outputted and displayed on a display 29. 

[0089] Moreover, when a field angle is set as a different value, corresponding sensibility function 
data Is read from each sensitivity function memory 19r, and g and b, and same processing is 
performed. 

[0090] As explained in full detail above, the case where aberration is in a taking lens according to 
this example, and a focus are applicable also to automatic focus accommodation, without using 
many lens groups, since it is possible to restore a subject-copy image if even the sensitivity 
function is known without measuring PSF when the gap has arisen. 

[0091] While carrying out optical-path change, the precision of a restoration image can be raised 
by [ the ] interlocking a field diaphragm and making it drive by using a part of optical system as a 
liquid crystal lens, so that the light of a photographic subject image may carry out incidence to 
the whole image sensor then and futility may be lost. 

[0092] Moreover, in this example, since it was made to memorize after carrying out the data 
compression of the sensitivity function, the storage capacity of sensibility function data does not 
have **, and came to end. 

[0093] Furthermore, in this example, since it restored using the sensibility function data in the 
three primary colors of RGB, it is possible to restore a color picture good. 

[0094] Moreover, at this example, it is Hs T. By changing, it is possible to display with the easily 
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different number of pixels. 

[0095] Furthermore, in this example, when an image sensor has a pixel defect, a subject-copy 
image can be restored correctly. 

[0096] In addition, if only it asks for sensibility function data H in this invention, since there is no 
limit of the number of pixels of an image sensor or the location of a pixel, it is possible [ a limit ], 
although the image was restored using all the pixels of CMD10 in this example for the random 
sampling of a suitable pixel to also restore an image correctly, 

[0097] moreover — although sensibility function data H was memorized in this example — the 
time of storage of sensibility function data — Hs T+ (HHT) up to — it calculates and you may 
make it memorize this 

[0098] Although it was made to drive the source of the illumination light in measurement of a 
sensitivity function, you may make it drive the image pick-up section which fixes the source of 
the illumination light and consists of CMD or a lens system in this example. 
[0099] Furthermore, in a sensitivity function storage means, a sensitivity function may be 
measured by carrying out sequential migration and displaying the point which is equivalent to the 
source of the illumination light using a monitor 31 and a control indicator 32 like drawing 6 . 
[0100] Furthermore, as shown in drawing 7 (a) and (b), you may make it move two or more lens 
33a and b t although a liquid crystal lens is used at the time of zooming and it was made to 
change an optical path at it. 

[0101] In addition, drawing 7 (a) and (b) show the case of a wide angle image pick-up, and the 
case of a looking-far image pick-up, respectively, and have the relation corresponding to drawin g 
5 (a) mentioned above and (b). 

[0102] Next, some different examples from the 1st example are explained. 
[0103] In the 1st example mentioned above, as shown in drawing 3 , restoration of a subject- 
copy image and the image with which sensibility-related was measured and picturized under the 
conditions that the distance to the taking lens in optical system is fixed was performed. 
[0104] However, in fact, in order for a sensitivity function to change from a taking lens according 
to the distance to a subject-copy image, it needs to measure the sensitivity function according 
to this distance, and needs to restore a subject-copy image based on it. 
[0105] Then, the 2nd example based on this principle is explained below using drawing 8 - 
drawing 10 . 

[0106] In addition, the same sign is attached about the member which carries out the same work 
as the 1st example mentioned above. Drawing 8 shows the block diagram for creation of the 
sensitivity function in the 2nd example, and a restoration filter. A different point from the 
example shown in drawing 1 in this drawing 8 is the point of using the stripe type color filter 
array 39 as [ shown in drawing 9 (a) ], and the distance Di to the source 1 of the illumination 
light, and a taking lens 4, instead of a rotation color filter, in order to acquire a color signal. It is 
the point which responds and creates a restoration filter. 

[0107] In drawing 8 , a reference mark 34 is distance measuring equipment (AF sensor), and it is 
the above-mentioned distance Di. It ranges. 

[0108] A reference mark 35 is a color separation circuit, divides into each chrominance signal of 
R, G, and B the color signal picturized using the color filter array 39, and outputs it to the 
sensitivity function memory 16r, 16g, and 16b according to each color. 

[0109] Reference marks 36r, 36g. and 36b are +. as it is a restoration filter calculiation machine 
and is shown in drawing 9 (b) (HHT). The calculation machine 26 and Hs T It is Hs T+ (HHT) by 
being constituted by the calculation machine 27 and the multiplier 37. A restoration filter is 
calculated. 

[01 10] moreover, the reference marks 38r, 38g, and 38b — R, G, and B — the memory for 
memorizing the restoration filter which boiled, respectively and was calculated — it is — 
distance Di It is constituted so that it may respond and may be written in the corresponding 
address. 

[0111] And the distance of the source 1 of the illumination light and a taking lens 4 is changed 
by X-Y stage 2, and it is the distance Di. It measures with distance measuring equipment 34 (AF 
sensor), and the computed restoration filter is written in the corresponding restoration filter. 
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distance Di **** — for example, it considers as the I piece selection (D1 - DI) from near to near 
(x). 

[01 12] Drawin g 10 shows the restoration circuit of an image. 

[01 13] In drawing 10 , reference marks 40r, 40g, and 40b are filtering machines, and they are the 
image data gR from the frame memories 16r, 16g, and 16b according to each color, gG, and gB. It 
is based and restoration image data R\ G\ and B' are computed from a degree type. 
[0114] 

R -eR gR — (8) 
G-eG gG — (8') 
B'=eB gB — (8") 

They are eR, eG, and eB at this (8), (8'X and a formula (8"). It is a nxm matrix (it is here, and n is 
the measurement size of a sensitivity function and m is the number of pixels of CMD), and they 
are gR, gG, and gB. It is mx1 matrix. 

[01 15] In addition, in drawing 1 0 , reference marks 41 are output units, such as CRT and a video 
printer. 

[0116] Next, the operation is explained about restoration processing. 

[01 17] After the picture signal of the photographic subject 30 picturized by CMD10 under proper 
light exposure is changed into a digital signal by A/D converter 13 through pre amplifier 12, the 
color separation circuit 35 separates into the data according to each color of R, G, and B, and it 
is memorized by frame memories 1 6r, 1 6g, and 1 6b, respectively. 

[01 18] On the other hand, it is the distance Di to a photographic subject 30 by work of distance 
measuring equipment 34. It is measured and is the distance Di of each color by the address 
controller 20. The corresponding restoration filter eR, eG, and eB are read from the restoration 
filter memory 38r, 38g, and 38b. 

[01 19] And with each filtering vessels 40r, 40g, and 40b, (8), (8'X restoration signal R' obtained by 
performing the operation of a formula (8"), G\ and B' are outputted to an output unit 41, and the 
image display to CRT etc. is made. 

[0120] according to the 2nd above example — each distance Di every — since a restoration 
filter is designed and the restoration filter was chosen according to the distance to a 
photographic subject on the occasion of restoration processing, also when the distance to a 
photographic subject differs, suitable restoration processing can be performed. 
[0121] Moreover, in the 2nd example, since the color filter array is used instead of the turnable 
filter, a rotation color filter like the 1st example and its driving gear become unnecessary. 
[0122] Others of this color filter array, such as not only a stripe type but a mosaic type, a check 
type, etc., may be proper. 

[0123] Moreover, although the field angle is not changed in the 2nd example, a field angle may be 
changed like the 1 st example. 

[0124] By the way, it is the distance Di to a photographic subject in the case of restoration 
processing in the 2nd example. The distance measuring equipment (AF sensor) for measuring 
was needed. 

[0125] Then, the 3rd example explained below is the case where distance measuring equipment 
(AF sensor) is not used for the formation of small lightweight of the image pick-up section. 
[0126] Drawing 1 1 shows the block diagram of the restoration processing circuit by the 3rd 
example. 

[0127] In drawing 1 1 , a reference mark 45 is a distance detecting element, and is constituted 
from the brightness detector 42 for detecting B' to restoration data R' as shown in drawing 12 
(a), G', and brightness data Y\ and brightness Y' by the maximum detector 44 for detecting the 
contrast memory 46 for memorizing the contrast detector 43 and its contrast value for a band 
pass filter etc. detecting the contrast of an image, and the maximum of a contrast value. 
[0128] Next, an operation of the 3rd example is explained. 

[0129] First, the photographic subject signal photoed like the 2nd example is memorized by 
frame memories 16r, 16g, and 16b after color separation. 

[0130] And a controller 22 is minded and it is the photographic subject distance D1 by the 
address controller 20. A corresponding restoration filter is read from the restoration filter 
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memory 38r, 38g, and 38b, and restoration signal R\ G\ and B' are called for with the filtering 
vessels 40r t 40g, and 40b. 

[0131] And brightness data Y f is called for by the brightness detector 42, a contrast value is 
continuously calculated by the contrast detector 43, and it is the distance D1 of the contrast 
memory 46. It is written in the location corresponding to a location. 

[0132] Next, photographic subject distance D2 A corresponding restoration filter is read from 
restoration filter memory, a contrast value is calculated similarly, and it is written in a position. 
[0133] the above processings — photographic subject distance DI up to — the contrast value in 
each distance is calculated by being carried out. 

[0134] In the maximum detector 44, the distance Dmax (refer to drawing 1 2 b) from which the 
contrast value serves as max is outputted to a controller 22. Again, it is distance Dmax. 
Restoration data R\ G\ and B' are outputted to an output unit 41 by reading the corresponding 
restoration filter from the restoration filter memory 38r, 38g, and 38b, and performing restoration 
processing with the filtering vessels 40r t 40g, and 40b. 

[0135] Since it restores by choosing the restoration filter with which a contrast value serves as 
max in the 3rd example as mentioned above, the image which did not depend on the distance of 
a photographic subject but focused can be obtained. 

[0136] therefore — since distance measuring equipment (AF sensor) is not needed in the 3rd 
example and it is not necessary to move a taking lens — a light weight — the small image pick- 
up section can be offered. 

[0137] Moreover, in the 3rd example, since the range and location can be freely set up in case 
the contrast detector 43 detects contrast, a location [ a location ] to make it focusing freely can 
be specified after photography. 

[0138] In addition, for example, the tongue (not shown) from which the read-out location of 
restoration filter memory changes is formed, and while an observer operates this tongue and 
checks a restoration image on the screen of a display 41, you may make it choose the image 
which should be outputted, although the restoration filter was chosen in order of distance by 
control from a controller in the 3rd example. 

[0139] The above-mentioned example restores the whole screen and is (HHT)+. With a 
calculation vessel, the operation which asks for the generalization inverse matrix of a mxm 
matrix will be carried out. 

[0140] Usually, there are about 5002 = 250000 and m is HHT. Asking for a generalization inverse 
matrix becomes quite complicated. Then, it is HHT by dividing a screen finely and designing a 
restoration filter for every division field of the. It is possible to make a generalization inverse 
matrix easy to make a dimension small and to ask by this. 

[0141] The 4th example explains the case where the technique by division of this screen is 
adopted. 

[0142] In this case, division of a screen shall perform 4= 4x16 division like drawing 13 (a). 
[0143] Drawing 14 shows the block diagram of the important section of the restoration filter 
calculation circuit for every division field in the 4th example. 

[0144] 50 is a control section for writing memory here. In this 4th example, a sensitivity function 
shall measure like the above-mentioned example. 

[0145] And with the restoration filter calculation vessels 47r, 47g, and 47b, using the sensitivity 
function corresponding to each division field, a restoration filter is computed and it writes in the 
division restoration filter memory 48r, 48g, and 48b. 

[0146] Drawing 15 shows the block diagram of the restoration processing circuit by the 4th 
example. 

[0147] In this 4th example, the place by which it is characterized is to compound each division 
field image restored by the image composition circuits 49r, 49g, and 49b, and restore the whole 
screen, after it reads the division restoration filter which corresponded for every division field 
from the division restoration filter memory 48r, 48g, and 48b and the filtering machines 40r, 40g, 
and 40b restore. 

[0148] In addition, it is Matrix HHT, so that the number of partitions is lessened in the 4th 
example. A dimension becomes small, and while becoming easy to carry out count, the 
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calculation time amount of a restoration filter can be shortened. 

[0149] Moreover, in case a screen is divided, when each division field has an overlap field 
mutually like drawin g 13 (b), discontinuous connection of the compound image can be avoided. 
Moreover, even if it uses the conventional successive solution method instead of calculating an 
inverse matrix, it is possible natural. 
[0150] 

[Effect of the Invention] As mentioned above, in this invention, the sensibility function data of 
image sensor each location was memorized certainly, using the sensibility function data of image 
sensor each of this location, it was not analytically influenced of optical system as a sequential 
image, but the subject-copy image was made possible [ restoring correctly ]. 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

"I.This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3.1n the drawings, any words are not translated. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is drawing showing the configuration of the sensitivity function measurement 
means used for the 1st example of this invention. 

[Drawing 2] It is drawing showing the configuration of the image restoration means of the 1st 
example of this invention. 

[Drawing 3] The explanatory view of the sensitivity function of this invention is shown. 
[Drawing 4] The sensitivity function of this invention is shown. 

[Drawing 5] It is the block diagram showing the field angle setting device of this invention. 
[Drawing 6] It is the block diagram showing the modification of the sensitivity function 
measurement means of the 1st example of this invention. 

[Drawing 7] It is the block diagram showing the modification of the field angle setting device in 
the 1 st example of this invention. 

[Drawing 8] The block diagram for the sensitivity function in the 2nd example of this invention 
and restoration filter creation is shown. 

[Drawing 9] Drawing 9 (a) shows an example of the color filter array used for the 2nd example of 
this invention, and drawing 9 (b) is the block diagram showing the restoration filter calculation 
machine used for the 2nd example. 

[Drawing 10] It is the block diagram showing the restoration circuit of the image by the 2nd 
example of this invention. 

[Drawing 1 1] It is the block diagram showing the restoration processing circuit by the 3rd 
example of this invention. 

[Drawing 12] Drawing 12 (a) is the block diagram showing the distance detecting element used 
for the 3rd example of this invention, and drawing 12 (b) is drawing for explaining that the 
distance information which gives the maximum contrast value in the distance detecting element 
used for the 3rd example of this invention is outputted. 

[Drawing 13] Drawing 13 (a) and (b) are drawings for illustrating the division gestalt of the screen 
in the 4th example. 

[Drawing 14] It is the block diagram of an important section showing the restoration filter 
calculation circuit for every division field in the 4th example of this invention. 
[Drawing 1 5] It is the block diagram showing the restoration processing circuit in the 4th 
example of this invention. 
[Description of Notations] 

1 Source of Illumination Light 

2 X-Y Stage 

3 Field Diaphragm 

4 Taking Lens 

5 Liquid Crystal Lens 

6 Drawing Driver 

7 Liquid Crystal Lens Driver 

8 Turnable Filter 

9 Color Filter Driver 
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10 Charge Modulation Element (CMD) 

1 1 CMD Driver 

1 2 Pre Amplifier 

1 3 A/D Converter 

14 Subtractor 

15 FPN Memory 

16 Sensitivity Function Memory 

17 Compressor 

18 Change Circuit 

1 9r Sensitivity function memory for R 
19g Sensitivity function memory for G 
1 9b Sensitivity function memory for B 

20 Address Controller 

21 Field Angle Setting Circuit 

22 Controller 

23 Frame Memory 

24 Change Circuit 

25 Expandor 

26 HHT+ Calculation Machine 

27 Hs <SUP>T Calculation Machine 

28 Fe(R) Calculation Machine 

29 Display 

30 Photography Photographic Subject 

34 Distance Measuring Equipment (AF Sensor) 

35 Color Separation Circuit 

36r, g, b Restoration filter calculation machine 
38r, g, b Restoration filter memory 
39 Color Filter Array 
40r, g, b Filtering machine 
41 Output Unit 

45 Distance Detecting Element 

47r, g, b Restoration filter calculation machine 

48r, g T b Division restoration filter memory 

49r r g, b Image composition circuit 

50 Control Section 



[Translation done.] 
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BKot, ^TttftSM"* J: 5 (cMMftBtc i 9 StfJ-f $ c 

[0 0 5 3] CCT'&SBBIScHtea, 0 4tC7jVf i:-5fc 
ff »flfca*»B«{M7©Stt*Mi#, $ fcPJtffifc 
SB*BflMttBT?©SM^#*M.Pt> © fct 3 c 

[0 0 5 4] *LT, C©SWHRttBJP!ifcWl*1"& 
t fttf 6 aWRB«ffilT?a«^ * C t K £ t) 

[0 0 5 5] ®JglWf&i9Js£¥f8©llf*tfJftttffl© 50 
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8*RK-fevM,fc», HftH8S@H2 lt«t»)Hft* 
0nax (05 (a) KfBS) fcftfciSfc, ft 9 K^-i' 
/<6«DllPJWlcJ: 3*HfflIf*tttK. K*U 

> X H 7 << > * 7 ©M VK <fc 0 ftfl 1/ >X 5 fcBWT 5 . 

[0 0 5 6] flt> BBttLb©ttB&H5 (a) ©«fc 
3fc4Slf*nttI (xl. x2. -xn) T-Sf#U BWJfc 
B 1 *KBB±©ffiBxl£X YXT-S?2©Blbfc:J: 5 
fcftU CMD 1 0T««*fr3. 

[0 0 5 7] CCT% 8!»tt?>3i:»ftU>X5fcJ:* 

iotc (6) 3* 0W£Ba*S{fc*-frft 
-i>#WH6?a&3tf» «7ES-&fc^*¥fl£»©Jte©#* 
«tO^<A7J-rscttcj;D, «7E©ll&£fi±£-t£?> 
*i4fci6C©J:^aBftKe@a2 ltfKttTfc*. 
[0 0 5 8] AftfttCB5 (a) tt, /fcSU^XKffiS 
f««*©WT?* D, tWFtS[0 3tt/£<IW*, »ftu> 

x 5 ojbst *a f-oBSf < ft* ck 5 icmmzti 

[0 0 5 9] fit, 05 (b) ffl^MSU^Xli: 
fflS"r**fc©0VC»!K «Bttt>3ttK<> «ftU> 
X5 ©B^B^CJBSMJtf'h* < ft* J: ^KIWBSti 

[0 0 6 0] -3ft), SiS©*^tc^BlU^X5©S»f 
^0 5 (a) fcrau-e***:, »«*?©-Wte Lfr 
^ttftW^AWUS: 0 5 (b) 0*3fc 

*^ A» LMtt« ft < t £ t *^T* # 5 o 
[006 1] Sfc, 3a«ftW>X5*flH/''* 

[0 0 6 2] fttJ, C<DBft{*3>h_a-'72 
TBftK£0K2 lKTHKtRlttftfiiln ~6niax ST' 

[0 0 6 3] We. CMD 1 0©il^i T'ffl^?nfcji 
7yf\ 2T«Mi*ft» A/DX#(B1 3T*r->*^;WH 
5 KEtl* C MD<D@S/^->yi'XA^SE 

* tifcsat^fi^-rftfc-BautHftr-* t Lxmg. - 

MR^^r'J 1 6©#ff©!SlMlc»*&Sn*. 

[0 0 6 4] ^LT, ^tcB^^ii i ^x2©ffiB'^il 

MRy^'J 1 6©«T©S2MKffl3-r4ttB'\»*i& 

ty 0 wt» HWjttB^xnoffiBttftftSTnaoayi* 

•t'J 1 6lcS#]^ty 0 

[ 0 0 6 5 ] Z UT, ^gMSt^ t U 1 6 ©&<8ttES§ 
g§l 7tcT^©f ? -^l^E*i*n, jWM8Sr-*H 
0max fcLTRfflSacMB^tU 1 9 rKiatSn*. 
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[0 0 6 6] ffift£0int «:tt/hS< LTHttMC 
^*froT»&ft*fflfiMRr-*H8iax-int £R 
fflBBMR^t'J 1 9 rWE«-f*. 

[006 7] ^LT, COLICS int tcim%2>&W. 

0min fcfcSSTHBOfcyifcBOig*. 
[0 0 6 8] ftfc, «ttifc:*5^T(i*0»»«:RB»© 
BfSffiBxl~xnOBH*9»-rs n &BT«-f * C i: 

[0 0 6 9] W±T\ RBBfctt-fSBBBRf*-*© 10 
E«*»A, HBfcLTG. BB«W>«*HRr-*t, 

*«>6tL ^n^tiGfflaatBR^t'j 1 9g&tfBffl 

U 1 9 bKE««*U .«KBRr-*©E 

[0 0 7 0] C0iiJ£fc<fc»3#&6nfc<glSlMR 
f'-^ffl^TBRB^ic J; OBBSftfeBBOttjE* 
BB»rc¥B*R*.fcB«KBfcoi,">TBMI3-r 

[00 7 1] H2tt, ±E»KBBR»£#»fcJ:oT# 

[0 0 7 2] ft ft, 0 1 fcRRftflWifcO^TttEM? 

[0 0 7 3] H2tfi^T. ±EB 1 ©BBMRillJE* 
StC*>^-SM»&§ 1 4 KBB7*-**E1*r*7 

2 3*a»ws. 
[0074] zlx. Huctev^Ttt«o»Aiaei 8 

*^LTEE«HB1 7tea«LT^fcRJflB*MR**y 

1 9 r, Cffl£KflR;«*U 1 9 g, BfflBBHR;** 30 
'J 1 9 btt, H 2 (cfci,>T«\ 7 KU**I»»2 OtcO 

[0 0 7 5] CO^t'Jl 9r, 1 9 g. 1 9 bKtt 
±iBLfcJ:3l«:LT J tft* f ttR. G, BWm<D®&ffl®L 

fc46<O^Jt)exlHlK2 4ti3yha-7 2 2tc^Jj!*tl 

[0 0 7 6] -f-L/Tv B«*7c¥a4:UT«I!3*AiaB 

2 4lif ? -*#fi3S2 5*^-LT (HH' ) ' Wffif§2 
6RtfH. ' m*8§2 7fc&m-$ftZo 40 

[0 0 7 7] SSlc, *0#JKUtt*&tfMEB«T- 

* £>)'&7tm®T-$zm&?'« . tftfe&gtug§2 

6, 2 7M71/-A^t'J 2 3t* fe(r)WaH2 8tC 

[0 0 7 8] *LT, S»tt0 3*^LT«BU>X5 
£DH»S&T5{tfg«2|<*3 0©«7cB»*S*T* 
SI^SS 2 9 fi f eOOfttBB 2 8 lc&ffi2t\%<, 

[0 0 7 9] *fc±E*J*fc*3< Bft«7cSB<0flUiI 

[0080] mmmft 3 0 tc*tr 55ifi*%$ 50 
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[008 1] *LT\ 0^Lftl«^C<fc9 CMD 1 

-7 2 2*ftLr&7 4)l>9 K7l'^9{C<fcoTRK-t 

[0082] S&fc, aH»B¥f*3 0*%*S3. 4, 
5£ftLTCMD 1 0£TB»*nT«&tt4B«ffi^ 

tTr^*;l/fll^KB»«n, BUB 1 4 KT F P Nff 

$g^ttfc&7l'-2^^'J 2 3(ce{£r-*g(r) i: 
LTf2t§$tl<&<> 

[0 0 8 3] 7KU*M»B2OfcJ:!>Ba0fc 
»£Lfc«BHRr-*Htf RfflBBBBR**'.; 1 9 r 

fr&«*ajsn, ««?»*iaB2 4*^urr-*off 

[0 0 8 4] 7*-*ttftB2 5-ptt«*IM»H*a^* 

tU (HH 1 ) ' JltU»2 6£tfH, ' JMHH2 7'\A 

[008 5] (HH' ) ' *{BS2 BTttS-f (7) St 
KJJOHH' «D#J«#tftt*S*U «&">T (HH' ) * 

[0 0 8 6] H, ' »tU8§2 7T'(inffi<DS^A> 

5ft*«a#*hi(r)fr6Bw©fc»0sffl©B**B 

#46 f e(r)SU}§S 2 8 icklJt 5„ 

[0 0 8 7] f e(r)StB§§2 8T'fi7b-A^€-'J 2 3 
=kt)A^tn5g(r) . (HH 1 ) 3StUf§ 2 6 <fc 9 A 
73*n5 (HH' )' &tfH. ' Sffl8§2 7.fc^)A;'^^ 
n.5H. ' it) (7) SKB^^TRO«7cB»r-* 

fe(r)**ttlU aiSSEB2 9'\Hi*rr*. 

[0 088] 2£fcG, BBBKOi^TfeBtHtBTEB 
{ix-^gftL/^ B*»B2 9'\tB**tiTaEw 

[0 0 8 9] Bft£iiftSffllcK£Lfe«£& 
»£Lfc«SHRT-*J^*KMR**'J 1 9 r, 

g. b*»6R*ta«nra«ft«Bi*»fftjn*. 
[0090] Jci±siEUfc«fc3K:, *nmmicnm£. 

*£fcfc^Tt» P S F*tHW**C fcftbfcBBHR* 
A to o T l*ft If BBBSRjc-r 5 C t "TB T'h & It 
6£<<DU>XS*ffl^*C£ftLfcg»^BHJfc:fc 

[009 1] ^-O^tttBitB^^KB^R©^ 

[0 0 9 2] Sft, *Hfii6(5lJT*«^JSMR*r-^E^ 



(6) 



[0 0 9 3] *6fc, *HJS«T?a:RGB©3JSlfeT'0 

lC«7tT S C t nnHTft So 
[0 0 9 4] Sfc, H, ' ^^l-TSCi: 

fc:J:t>, 8»tcsa*B*»T3|jS**citf^BT* 

[0 0 9 5] ^ffift?(iaH*£?l«:B£fcK 
#*«B£fc£^Tfc«B«*iEL<«rc*3ci:tf-e 10 

[0 0 9 6] tt*, *H)5g#IJT'(iCMD 1 0O£BB* 

[0097] sfc, **»«y-ett««Bii*f f -*H*E 

-5 fctfctf, JSBBttT-^oettWfcH. 1 
(H H 1 ) ' *-ettWLTCft*iEtt-r**5lcLTfc 

20 

[0 0 9 8] *^jK60ljT'(±®gM^©iJ^JCi3^T?,a8^ 
«W*Bilf * <k 5 fc Lfctf SWI>fc**BJS UT C M D 

V\> 

[0 0 9 9] *&lc, «*M»JE«#Sk:43^Ttt, B 

[0*100] *6fc, X-3>^tfiSU>X*ffl^ 
TJteBfcSffcStfSiSfcUfctf, 0 7 (a) , (b) 30 
KS-T«J:-5tt«»«!>l'>X3 3 a. b*»»***J:5 

[0 10 1] 443, 07 (a) . (b) tt^ttf'tiJEft 

05 (a) , (b) KW*SLfcBflfi**UT^*o 
[0 10 2] £lXli0M: «»O3^0*« 

[0 10 3] WiSUfc)fllllJM!lt»ttH3KSLfcJ:5 
t, WB»4:3tt**KlB*t*fflBL'>X*T?OBB*«- 
3£T»* *fr©TT««Mff©WJ£fttf»»*n 40 

fcB«M>l*7Ctf{Tfc*lfc. 

[0 10 4] LfrU XRlCfiAl*Hft(*. »i*U>X* 

R' =e. g. 
C =ec gc 
B' =e. gi 

CCD (8) , (8' ) . (8" ) e. , ec , e 

CMD©B*») fiOg. , gc , g. Itmx 

1 fifMT**. 

[0 1 1 5] 0 1 0K*^T#BWHH lttC R 50 
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^6fiRB«*TOB«k:«;i;Ta{fc'r«fci<>, cosggn 

[0 10 5] fCT', #(C, COSatcSV^c^2^Ji 

[0106] waufcS8i*JWWfcrai;iit*-r 
*»#Ko^'»Ta:rat;??<**f*-r. 0 8 urn 2 uss^t 

Sj6tt*7HB****fcafc®ftft7-<;l/*0ftfcD 

[0 10 7] H8fcfc^T«Hflra3 4 ««§g@ (A 

[0 10 8] mm^3 5(ife»H[sl8§T'£0, #7- 
7-nl/*7'LH' 3 9*fflV^Ttl**nfc*5-fi^* 
R. G. BO*feffl^k:#«LT*ft»JO«JtB8k/t 
D 1 6 r, 1 6 g, 16 blC&jJtZe 

[0 109] #!!W5f3 6r, 3 6g. 3 6btt«7E7 

-r;i>*llttiB-eJ&»>, 09 (b) tcjjVfidfc (h 

H' ) ' StUg§2 6, H. T 3?Hli§2 7, &tfSIWS33 
7K±9B)«*ti*{:tKJ:D 4 H. 1 (HH 1 ) ' £ 

[0 1 1 0] mm%38 r, 3 8g, 3 8btt 

r. g, BZirizwz.tmLTzm.Tiy < 

[0111] fLT> WMXMl fc»12U>X4<DS§8t 

SESH3 4 (AFt^) fcTfHWU BtflLfctt7t7 

»ctt«i|AtfSfi^6 (x) ttj££T'© IffliltR (D, ~ 
D. ) 

[0 1 12] 01 OttBBOttTCHB**^ 
[0 1 1 3] 01 0t*^T, #P,8i?*f 4 0 r. 4 0 
g, 4 0b»7-</l/4";>^B-e*t), £feSiJ<07U- 
A^^Ul 6r, 1 6 g. 1 6 bfrStOBIfrr-* 
g. . gc g. K||^TB7cBB7 f --*R' . G' . 

b' *as«fct)Bta-r*. 

[0 1 14] 

- (8) 

- (8' ) 

- (8" ) 

[oi i6] ^ffiTcjaafco^T^wftffl^ittwr 

[0 1 17] )IIE£&ft!<DTtC C M D 1 0(Cj:t>IIB 
*ftfc*39ft3 0©BBffl^tt7 , 'JT>7'l 2*^>LT 
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A/Dg&H 1 3 J: & ri/**/m*fc£«2ftfcft, 

fettHtlDgg 3 5 IC J: t) R . G, B 

li«n, 7U-Wty 1 6 r, I6g, I6btc^n 

[0 1 18] -7i, iRiJSg^S 3 4 ©IS tlC 3 
OSTCKHDl tffffiJSft, 7KU*iMWS2 0KJ: 
9&fe©!gg£Di fc*«?**tfi7c7-f;l'*ei , ec , 
ei7b^7t7-c;l/^^ : e | j 3 8 r. 3 8g, 3 8 bit) 

[0 1 1 9) tUT, *7-f7l/i"J^«4 0 r. 4 0 10 
g, 4 0bfc£9> (8). (8'), (8" ) g.<Dm 
Htffftoti*ci:KJ:»)fl6nfca7cfll^R' . G' . 
B' tftfi73gfi4 l'MtirtStt* CRT'sOBBS** 

[0 12 0] tt±©*5*S2*jMWK:<fcfttf, £8§8i 
Di Sic, B7c7^l/**8«-U Sfc. tt7C*Bi©* 

[0 12 1] Sfc, JB2SasW-PH:0K7-f;I/*Oftt) 20 
©J: ? £HI$Efe7 -1- ;l/*Rtf ; £©SKSj2£S&'Fg t £ 
[0 12 2] C©A5-7-f ;U*7Wt4Xh5-l'7'^ 

[0123] g-fc, »2jii««ye«iift*a{t«-&Tir^ 

[0 12 4] tC5T\ ^2^ffl^JT'{4^7C^a«C 
*¥tt*-C©e«Di £ffHl|-*-«fc«>©jl!Ug&B ( A F 30 

[o 1 2 5] *c-e % ^i<:Mi»-r«9i3^tt0gtt, 

[0 1 2 6] 0 1 1 Ug3 3&ffifNK£«&7cffl9!lI&© 
HUSH**"*". 

[0 1 2 7] 0 1 1 tCfcl^T, «Kt?W4 5«Efi^ai 
g|5T'fe?3, 012 (a) K^-fJ:dfc«7tx-*R' . 

c , b' a^wsx-^y' *tta-r*fci&«>»att 

H18b4 2, iHfiY' K^7-<;I/*tSfc < 3: OH 40 

4 3, SD'^Wa^h^Xhfl^fSig-rSfcAtDayh 

[0 12 8] fcfc, SnSSWWOttfflfc-^TBMHI- 

So 

[0 12 9] 5fc1\ £2£ffiM£H8k:!lE2ftfttt5 
ttflWtt, £#gtf£, 1 6 r, 1 6 g. 

1 6 blCietf£ft3o 

[0 1 30] *UT» 3>HD— 72 2*^UT7Kb 50 
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**J»B2 0KJ;>>, tt?ttEMD. ictB^t *1S^7 
W>l/*tf&7G7<f;l/*;«*y 3 8 r. 3 8g, 3 8 b*» 
<bmfr&Zft. 7^;b^'J>^*S4 0 r, 40g. 40 
bfc«fcD«7cfi^R' . G' , B' jtfcjto&ft*. 

[0131] f L/T> $gfcUJ8§4 2{cJ;0WSr-^ 
Y' tf*i65>n, «t'»T3>'K7^htta«4 3K«J:») 
s^h^ahfWjRfc&ti, nJ'h^Mty 4 6© 
EftD. ©toBfctt£UfcffiBfc:»*&*n*. 

[0 13 2] «¥tt8EltD 2 EtBS-f 3&7t7-f 
tf&7c7^;l/**€Ufre>g?#tH2n, IHJBfcLT 

[0 1 3 3] W±OJ:?*«ia3W([¥f«aiDi ST'ff 

[0 13 4] ft?ctttti&84 4 7?tt, ^3>F5XF 
ffitfft*£&*£SDiiax (0 1 2 b#Bg) £n> ha 

— ?2 2'\tti7rfS„ Wtf, SiStDmax lC*ttSLfc«7t 
7-r;I/^3b^7E7^;l/3'^ ; E:'J 3 8 r, 3 8g, 38b 
*>6R*ta*tlT7^;I/*'J>'y»4 0 r. 4 0g, 4 
0 bK«kO«7c«iatffT*t)n*cktJ:»)tt7cf f -* 
R' . C . B' tfUJ?j£B4 
[0 13 5] W±oi3tLTJB3Sa»iWPa:» ai'h 
5*h«ff»*fc**«7c7*;l/**BA/t?, «7C*fT 

[o i 3 6] sf-oT, %3niMmv&mmmm caf* 

[0 13 7] tit. JB3St«ffiTtt3>h774htta» 
4 3tCT3>h7Xh**ttbf*ieHC» ^©ffiffltffig 
fciEbfcKST* MBfcfcS 
fc^ffiB*tft£?*a. 

[0 13 8]**, JB3Sltt«T?tt3>hn-53&»&0 
Mfftc A 9 «tg7 * ;!/ * *agB©JR*|cg.s: £ 9 »C Lfc 
i\ 0y*tf, BT^^l^tyoKftaWftBtfSWfc 

aWbT«7cB«**S«B4 1 ©HiH±?«KL*# 

[0 13 9] ttafi©*W«ttWIi^%*7C , fSt.©'T? 

*»>, chh' ) wm^imxmmw-mitmfi 

[0 1 4 0] ji«m«5 0 0 ? -2 50000S&&, 
HH 1 0-ttftffifTW***i)*Cfc{4^!!t»>««llc* 
«. ^CT, HfflifcaKKtfWU ^©tfMflWMSK* 

7£7f ;l/^%^i+-r%<:t(cj;oTHH T ©#7c*/h* 

[0 14 1] ^4HS6^JT'{4, d OiS®£D^#itC «t S ^ 
[0 14 2] ®ffi©»tlJ«»IJ^tfEI 1 3 



(8) 
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(a) <D&?iC4 x 4 = l 6 #ffl*fT O 

CO 1 4 3] 01 4(i£4im£&tt«&«fRttS® 

tt7E7-f ;i/*itaiattoiai5<D«fiKH**-f . 

[0 14 4] CC-P5 0ttJ»tU«!)tt*»**fT3fci6 

[0 1 4 5] ^LT, it7C7^;l/*gtti8§4 7 r, 4 7 
g, 4 7bT*(i, &&fJ«l«lctt£Ufc£KBft*¥Jffl 

4 8r. 4 8g, 4 8 bfc8£&tr<> 10 
[0 1 4 6] 0 1 5li^4 jlffi^CfcS^TCSagiHlKtD 

[0 14 7] c©»4 jSMNMfcfc^T, 

87C7-f/U$»*-t'J 4 8 r. 4 8g, 4 8b*^K*tB 
LT7^;U5fijyygg4 0 r, 4 0g, 4 0 blC^Offi 
7C%ff-3fc», BB&ABB 49r, 49g, 4 9b K 

[ 0 1 4 8 ] * ib\ ffi 4 ^)5S(5tJT'«^«lJia^'> < 20 

t fcfc«7t7 *;l/*©Wttii*B*ffll8"r 5 u #T*£ 
[0 14 9] Sfc, Bffi*#Wr*Rfc, Si 3 (b) 
J^KTSdttcJ:^ £jftLfcBB®7£tt&8HR* 

[0 15 0] 

[f2W<D#j£l] W±, *^?a£*£?«HftB0&£ 30 
Bttf-**«*lcKttU C^tHWR^^ffiHOSfit 
B»f-**ffl^T\ BBft*£tfatycBMBB£LT 

[a i ] i nmmicm^zmmmmitt® 

[02] i mmm<Dm®&7L^®<o®&*7rs 

[03] ^XW<7)«ltHlftOB{nH«^-r. 40 

[04] *«&0&KHft**?. 

[05] *^QBft8&*ft«K?WttB7*%«. 

[06] *jffl(o*ingmo>B&mtmm s ffl0SBm 

[07] 1 3tH0J£&l**Bftfi£flm4>& 

[08] *^0g2*B0)IK&tt&^H8&tflk7C 

[09] 09 (a) tt*3^0B2£»ffllCffl^«*7 
-7^>7WO-|(«*U fi-309 (b) «£2 50 
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BBWfcffl^*«rc7*/U*»HiB***«J«B?* 

[01 o] *%m<D%2nmmic£mB<Dmji.®s%z 
[0ii] *femos3Hife0ii(cj:«fl[7cfflaBB«^ 

[01 2] 01 2 (a) tt*«W©J83*M0!lfc:JB^<& 

e«*aj»*w-r«wiB-t?*»K aosi 2 (b) «* 

5fci6<D0T'£>5o 

[01 3] 01 3 (a) . (b) fcl:£4£tt0)Jic*tt« 
Bffi©»W*IB*fflJw"r5fc*OHT**. 

[014] *%w<Dm4mMMicisv%ftmm®m<Dm 

[015] 4 ^flUffiJlc^ttSSTctoSlilSS^ 

35-r*ij«B"r**. 

1 BHftB 

2 XY7.T- V 

3 8HFfg{) 

4 BBUVX 

5 fgHL-yX 

6 &9 K7-f^ 

7 BftU^XK?^^ 

8 HMte7-f>l/£ 

9 S7-nl/*K7-Y^ 



1 0 


BffiSIBB* (CMD) 


1 1 


CMD YvJ* 


1 2 




1 3 


A/DB»B 


1 4 




1 5 




1 6 




1 7 


EESS83 


1 8 




1 9 r 




1 9g 




1 9 b 




2 0 


7KU*MWB 


2 1 


Bftttftelft 


2 2 


3> h-P — 7 


2 3 




2 4 


Wt>tf*.BIB 


2 5 




2 6 


(HH' ) ' BUB 


2 7 


Hs ' BUB 


2 8 


f eWWBB 


2 9 




3 0 





(9) 



$#^¥6-9 8 1 7 0 



15 

3 4 iMSBB (A F-te>-9-) 
3 5 fetffilHlSS 

3 6 r, g, b «JE7^1/$'WHiB 

3 8 r, g. b IS7L7-f ;l/*^*'J 

3 9 ■h=>~7 4 b*7l"< 

4 0 r, g, b 7^;l/^'J>y8§ 



* 4 1 
4 5 
4 7 r, 
4 8 r, 

4 9 r, 

5 0 



g. 
g. 
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»7&7^l/*mH3§ 

#fJ«7E7^l/***D 



[01] 



[08] 
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v 
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m ^ 

ft: * 



OD 



IK tf 



f8 



!K*3 



on 
fO 
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